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DETAILED ACTION 

1 . This action is issued in response to applicant filed request for continued 
examination (RCE) on 10/09/2007. 

2. No claims have been amended. Claims 60 - 64 were added. Claims 4. 13-17, 
19, and 24 - 28 were canceled. 

3. Claims 1 - 3, 5 - 12, 18, 20 - 23, and 29 - 64 are pending in this application. 

4. Applicant's arguments with respect to claims 1 - 3, 5 - 12, 18, 20 - 23, and 29 - 
64 have been considered but are moot in view of the new ground(s) of rejection. 

Continued Examination Under 37 CFR 1.114 

5. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 

10/1 1/2006 has been entered. 

Specification 

6. The specification is objected to as failing to provide proper antecedent basis for 
the claimed subject matter. See 37 CFR 1.75(d)(1) and MPEP § 608.01(o). Correction 
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of the following is required: Applicant has failed to provide antecedent basis for the 
claim temiinology "computer readable medium". 

Claim Rejections - 35 USC § 101 

7, 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

8. Claims 18, 20 - 23, 29 - 64 are rejected under 35 U.S.C. 101 because the 
claimed invention is directed to non-statutory subject matter. 

Claims 18, and 29 are not statutory because the claims merely recite computing 
steps without producing any concrete, useful result and tangible result and/or being 
limited to a practical application within the technological arts. Also, applicant has not 
provided an explicit and deliberate definition for "computer readable medium". 

Claims 37, 48, and 59 are not statutory because the claims merely recite 
computing steps without producing any concrete, useful result and tangible result and/or 
being limited to a practical application within the technological arts. 

That is, it must produce a "useful, concrete and tangible result." State Street, 149 
F.3d at *>1373-74<. 47 USPQ2d at 1601-02. The purpose of this requirement is to limit 
patent protection to inventions that possess a certain level of "real world" value, as 
opposed to subject matter that represents nothing more than an idea or concept, or is 
simply a starting point for future investigation or research (Brenner v. Manson, 383 U.S. 
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519, 528-36, 148 USPQ 689, 693-96 **> (1966); In re Fisher, 421 F.3d 1365, 76 
USPQ2d 1225 (Fed. Cir 2005); In re Ziegler, 992 F.2d 1197, 1200-03, 26 USPQ2d 
1600, 1603-06 (Fed. Cir. 1993)). 

Any claim not specifically addressed, above, is being rejected as incorporating 
the deficiencies of a claim upon which it depends. 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

* 

(a) A patent may not be obtained though the Invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the Invention was made. 

10. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S:C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 
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1 1 . Claims 1 - 3, 5, 1 8, 20, 29 - 31 , 37 - 39, 48 - 50, and 59 - 64 are rejected under 
35 U.S.C, 103(a) as being unpatentable over Wang et al. (Wang hereinafter) (US Patent 
No. 5,802,361 , filed: September 30, 1994) in view of Aggarwal et al, (K. K. AgganA^al 
and Yogesh Singh) (Non-Patent Literature: "Software Reliability Apportionment using 
the Analytic Hierarchy Process"; ACM SIGSOFT; Software Engineering Notes vol 20 no 
5; December 1995; New York, NY. USA). 

Regarding Claim 1 , Wang discloses a method of searching or browsing 
multimedia data comprising: 

(a) receiving reference multimedia data with a data structure (Fig. 2A, item 201, 
Col. 8, lines 7-17, Wang) including features of said reference multimedia data (Col. 8, 
lines 23 - 28, Wang) and weight information of said features. 

(b) searching for said reference multimedia data using the features and the 
weight information (CoL 8 and 18, lines 40 - 42 and 54 - 57; respectively, Wang); 

(c) receiving user feedbacl< on a relevance of resultant multimedia data found in 
(b) (Col. 8 and 9, lines 62 - 63 and 5-6, "any user supplied ranking of the image 
attribute"; respectively, Wang); 

(d) measuring a similarity of the reference multimedia data to the resultant 
multimedia data (Col. 13, lines 18-20 and 29-31, Wang^) and calculating a new 

^ Wherein the step of finding the luminance difference corresponds to the step of measuring a similarity 
as claimed. 
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weight information of said features using the measured value (Col. 18. lines 51 - 54, 
Wang^); and 

(e) updating the weight information of said features in said data structure of the 
reference multimedia data using the new weight information (Col. 26, lines 21 - 28, "for 
each image is reweighted with the new ranking value", Wang). 

However, Wang does not expressly disclose: reliability of weight information. On 
the other hand, Aggan^^al discloses: reliability of weight information (Page 57, 1st 
paragraph under Section: "Relative reliability weights", Aggarwal). It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to 
incorporate the AgganA^al's teachings with respect to reliability of weight information to 
the system of Wang. Skilled artisan would have been motivated to do so, as suggested 
by AgganA/al (Page 56, 3rd paragraph under Section: "Introduction", Aggarwal), to set 
reliability goals for individual modules such that the user's specified system reliability 
goal is met. 

Regarding Claim 2, the combination of Wang in view of Aggarwal 
(Wang/Agganval hereinafter) discloses a method, wherein in (c), increasing weights of 
features which would increase a similarity between the reference multimedia data and 
the resultant multimedia data if the user feedback is a positive relevance information 
(Col. 20 and 25, lines 10 - 13 and 64 - 67; respectively, Wang; and Page 57, 2nd 
paragraph under Section: "Relative reliability weights", AgganA/al). 

^ Wherein the step of assigning a numerical ranking value corresponds to the step of calculating a new 
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Regarding Claim 3, Wang/Aggarwal discloses a method, wherein in (c), 
increasing weights of features which would increase a dissimilarity between the 
reference multimedia data and the resultant multimedia data if the user feedback Is a 
negative relevance information (Col. 26, lines 5-7, Wang; and Page 57, 2nd paragraph 
under Section: "Relative reliability weights", Aggarwal). 

Regarding Claim 5, Wang/Aggarwal discloses a method, wherein a reliability of a 
weight assigned to one of said features is proportional to the amount of training by user 
feedback (Col. 18, lines 51 - 54, Wang; and Page 57, 1st paragraph under Section: 
"Relative reliability weights", AgganA/al). 

Regarding Claim 18, Wang/AgganA^al discloses a data structure embodied in a 
computer-readable medium for a multimedia data searching or browsing system 
comprising: 

a multimedia data (Fig. 2a, item 201, Col. 8, lines 10-15, Wang); 

a variable information representing features of the multimedia data (Col. 8, lines 
7-8, visual attributes, Wang); and 

reliability information representing a reliability of the variable information (Col. 8, 
lines 54 - 60, "analyzes the side information files to identify those images in the image 



weight information as claimed. 
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database that are most similar to the input image attribute", Wang; and Page 57, 1st 
paragraph under Section: "Relative reliability weights". Aggarwal). 

Regarding Claim 20, Wang/AgganA/al discloses a data structure, wherein the 
reliability information includes information on the number of variable information updates 
by a user (Col. 8, lines 62 - 64, Wang; and Page 57, 1st paragraph under Section: 
"Relative reliability weights", Aggarwal). 

Regarding Claim 29, 37, and 48, Wang/Aggarwal discloses a system of 
searching multimedia information, comprising: 

a storage device which stores a data structure (Col. 7, lines 13-18, Wang) 
having: 

(a) feature information corresponding to at least one image feature (Col. 8, 
lines 23 - 28, Wang), 

(b) weight information Indicative of an importance of the image feature (Col. 
12, lines 62 - 66, "different parameters weighted to reflect their significance to face 
identification", Wang), and 

(c) reliability information indicative of a reliability of the weight information 
(Col. 13, lines 18-20 and 29 - 31, Wang; and Page 57, 1st paragraph under Section: 
"Relative reliability weights", Aggarwal); and 

a processor which searches said multimedia information based on the data 
structure (Col. 7, lines 9-13, Wang). 
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Regarding Claim 30, 38, and 49, Wang/Agganwal discloses a system, wherein 
the reliability infonmation provides an indication of the reliability of the weight infomriatlon 
based on user feedback (Col. 12, lines 62 - 66, "different parameters weighted to reflect 
their significance to face identification", Wang; and Page 57, 1st paragraph under 
Section: "Relative reliability weights", Aggarwal). 

Regarding Claim 31 , 39, and 50, Wang/Aggarwal discloses a system, wherein 
the reliability information includes update information corresponding to the weight 

* 

information (Col. 26, lines 21 - 28, "for each image is reweighted with the new ranking 
value", Wang; and Page 57, 1st paragraph under Section: "Relative reliability weights", 
AgganA^al). 

Regarding Claim 59, Wang/Aggarwal discloses a method performed by a 
computing device, comprising: 

receiving an image (Fig. 2A, item 201, Col. 8, lines 7-17, Wang); 

extracting characteristic attributes from the image (Col. 8, lines 25 - 28, Wang); 

ranking the characteristic attributes of the image (Col. 8 and 9, lines 62 - 63 and 
5-6, "any user supplied ranking of the image attribute"; respectively, Wang); 

determining reliability of extracted characteristic attributes of the image (Page 57, 
1st paragraph under Section: "Relative reliability weights", AgganA^al); and 
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searching a database of images using the extracted characteristic attributes, the 
ranking of the extracted characteristic attributes, and the determined reliability of the 
extracted characteristic attributes (Col. 8 and 18. lines 40 - 42 and 54 - 57; 
respectively, Wang). 

Regarding Claim 60, 62, 63, and 64, Wang/Agganval discloses a data structure, 
wherein the reliability information is different from the weight information (Col. 13, lines 
18-20 and 29 - 31 , Wang; and Page 57, 1st paragraph under Section: "Relative 
reliability weights", Aggarwal). 

Regarding Claim 61 , Wang/Aggan/val discloses a data structure, wherein the 
reliability information is different from the variable information (Col. 8, lines 54 - 60, 
"analyzes the side information files to identify those images in the image database that 
are most similar to the input image attribute"; wherein the input image attribute 
corresponds to the variable information as claimed, Wang; and Page 57, 1st paragraph 
under Section: "Relative reliability weights", Aggarwal). 

Regarding Claims 60, 62, 63, and 64, Wang/AgganA/al discloses a system, 
wherein the reliability information is different from the weight information (Col. 13, lines 
18-20 and 29-31, Wang; and Page 57, 1st paragraph under Section: "Relative 
reliability weights", AgganA/al). 
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Regarding Claims 61, Wang/Aggan^^al discloses a system, wherein the reliability 
information is different from the weight information (Col. 8, lines 54 - 60, "analyzes the 
side information files to identify those images in the image database that are most 
similar to the input image attribute", Wang; and Page 57, 1st paragraph under Section: 
"Relative reliability weights", Aggarwal). 

12. Claims 6-11 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wang et al. (Wang hereinafter) (US Patent No. 5.802,361 , filed: September 30. 1994), 
in view of AgganA^al et al. (K. K. Aggarwal and Yogesh Singh) (Non-Patent Literature: 
"Software Reliability Apportionment using the Analytic Hierarchy Process"; ACM 
SIGSOFT; Software Engineering Notes vol 20 no 5; December 1995; New York, NY, 
USA), and further in view of Kinra et al. (Kinra hereinafter) (US Patent No. 5,731 ,991 , 
filed: May 3, 1996). 

Regarding Claim 6, Wang/Aggarwal discloses all the limitations as disclosed 
above including data structure of the reference multimedia data. Hovyever, 
Wang/Aggarwal does not expressly disclose authority infomiation. On the other hand, 
Kinra discloses authority information which limits an update of the weight information by 
a user feedback (Col. 6, lines 49 - 55 and 62 - 63, Kinra). It would have been obvious 

I 

to one of ordinary skill in the art at the time the invention was made to incorporate the 
Kinra's teachings to the system of Wang/Aggarwal. Skilled artisan would have been 
motivated to do so. as suggested by Kinra (Col. 1 . lines 50 - 54 and 66 - 67. Kinra), to 
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provide expert software evaluation, and to allow a user to emphasize which criteria in 
various alternate software products are most important to the user. 

Regarding Claim 7, the combination of Wang in view of AgganA/al and further in 
view of Kinra (Wang/Aggarwal/Kinra hereinafter) discloses a method, wherein the 
authority information includes a plurality of authority levels, wherein each authority level 
has degree values affecting the degree of weight information update in (e) (Page 57, 
2nd paragraph under Section: "Hierarchy of Software System", Aggarwal; and Col. 2, 
lines 24 - 27, Kinra). 

Regarding Claim 8, Wang/Aggarwal/Kinra discloses a method, wherein a higher 
reliability is given to user feedback by a user with a high authority level (Page 57, 2nd 
paragraph under Section: "Hierarchy of Software System", Aggarwal; and Col. 6, lines 
53 - 59. Kinra). 

Regarding Claim 9, Wang/Aggarwal/Kinra discloses a method, wherein in (e), 
updating the weight infonmation of said features in said data structure of the reference 
multimedia data depending upon the reliability information and the authority information 
(Col. 6, lines 57 - 59, Kinra). 
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Regarding Claim 10, Wang/Aggarwal/Kinra discloses a method, wherein the data 
structure of the reference multimedia data further comprises authority information which 
limits an update of the weight information by a user feedback (Col. 6, lines 59 - 63, 
Kinra). 

Regarding Claim 1 1 , Wang/Aggan/val/Kinra discloses a method, wherein the 
authority information includes a plurality of authority levels, wherein each authority level 
has degree values affecting the degree of weight information update in (e) (Page 57, 
2nd paragraph under Section: "Hierarchy of Software System", Aggarwai; and Col. 6, 
lines 62 - 63, Kinra). 

13. Claims 12, 21 - 23, 32 - 36, 40 - 47, and 51 - 58 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Wang et al. (Wang hereinafter) (US Patent 
No. 5,802,361 , filed: September 30, 1994), in view of Aggarwal et al. (K. K. Agganwal 
and Yogesh Singh) (Non-Patent Literature: "Software Reliability Apportionment using 
the Analytic Hierarchy Process"; ACM SIGSOFT; Software Engineering Notes vol 20 no 
5; December 1 995; New York, NY, USA), in view of Kinra et al. (Kinra hereinafter) (US 
Patent No. 5,731 ,991 , filed: May 3, 1996), and further in view of Rose et al. (Rose 
hereinafter) (US Patent No. 5,724,567, filed: April 25, 1 994). 
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Regarding Claim 12, Wang/Aggarwal/Klnra discloses all the limitations as 
disclosed above. However, Wang/Aggan^/al/Kinra does not expressly disclose a 
password. On the other hand, Rose discloses: receiving a password from a user to 
detemnine an authority level of the user (Col. 4, lines 30 - 34, Rose). It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to 
incorporate the Rose's teachings to the system of Wang/Aggarwal/Klnra. Skilled artisan 
would have been motivated to do so, as suggested by Rose (Col. 3, lines 60 - 63, 
Rose), to identify the user as having authorized access to the system. 



Regarding Claim 21 , the combination of Wang in view of Aggarwal in view of 
Kinra and further in view of Rose (Wang/AggaoA^al/Kinra/Rose hereinafter) discloses a 
data structure, further comprising an authority code (Col. 4, lines 30 - 34, Rose). 



Regarding Claim 22, Wang/Aggarwal/Kinra/Rose discloses a data structure, 
wherein the reliability information is variable and includes a number of authority levels 
(Col. 2, lines 24 - 27, Kinra), a degree of variable information update for each authority 
level (Col. 2, lines 10-12, Kinra), and a number of variable information updates by a 
user of each authority level (Col. 6, lines 55 - 59, Kinra). 

Regarding Claim 23, Wang/AgganA/al/Kinra/Rose discloses a data structure, 
wherein the reliability information is fixed and includes a number of variable information 
updates by a user of fixed authority levels (Col. 6. lines 51 - 55. Kinra). 
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Regarding Claim 32, 40, and 51 , Wang/AgganA/al/Kinra/Rose discloses a system, 
wherein the update information includes: 

s 

a number of times the weight information has been updated by a user (Col. 6, 
lines 55 - 59, Kinra); and 

authority information corresponding to the user (Col. 2, lines 24 - 27, Kinra; and Col. 
4, lines 30 - 34, Rose). 

Regarding Claim 33, 41, and 52, Wang/AgganA/al/Kinra/Rose discloses a system, 
wherein the authority information includes an authority level of the user (Col. 2, lines 24 
- 27, Kinra). 

Regarding Claim 34, 42, and 53, Wang/Aggarwal/Kinra/Rose discloses a system, 
wherein the authority level is based on an amount of experience of the user (Col. 6, 
lines 53 - 55, Kinra). 

Regarding Claim 35, 43, and 54, Wang/Agganval/Kinra/Rose discloses a system, 
wherein the update information provides an indication of how frequently the weight 
information has been updated (Col. 10, lines 49 - 54, Kinra^). 



Wherein the step of double clicking conresponds to the step of providing an indication as claimed. 
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Regarding Claim 36, 44, and 55, Wang/Aggarwal/Klnra/Rose discloses a system, 
wherein the update information provides an indication of how frequently the weight 
information has been updated by one or more users having at least a minimum authority 
level (Col. 6 and 10, lines 59 - 63 and 49 - 54; respectively, Kinra"*). 

Regarding Claim 45, and 56, Wang/Aggarwal/Klnra/Rose discloses a system, 
further comprising: 

an input unit which receives authority information corresponding to a user (CoL 4, 
lines 30 - 34, Rose); and 

a comparator which compares the authority information to predetermined 
information (Col. 6, lines 53 - 55, Modifier, Kinra; and Col. 4, lines 30 - 34, Rose^), 
wherein the processor updates the weight information using user feedback based on a 
result output from the comparator (Col. 2, lines 24 - 27, Kinra). 

Regarding Claim 46, and 57, Wang/Aggarwal/Kinra/Rose discloses a system, 
wherein the predetermined infonnation includes a password (Col. 4, lines 30 - 34, 
Rose). 

Regarding Claim 47, and 58, Wang/Aggarwal/Kinra/Rose discloses a system, 
wherein the comparator compares an authority level of the user to a predetermined 



Wherein the step of double clicking corresponds to the step of providing an indication as claimed. 
^ Wherein the user's identity corresponds to the predetermined information claimed. 
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authority level (Col. 6, lines 53 - 55, Modifier, Kinra; and Col. 4, lines 30 - 34, Rose^), 
and wherein the processor updates the weight information only if the authority level of 
the user is determined to be equal to or higher than the predetermined authority level 
based on an output from the comparator (Col. 2, lines 24 - 27, Kinra). 



Wherein the user's identity corresponds to the predetermined information claimed. 
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Response to Arguments 

1 . Applicant argues that; "Throughout the prosecution and during the interview, the 
Examiner did not acknowledge in any substantive way the Rule 132 Declaration of Jin- 
Soo Lee...". 

Examiner respectfully disagrees. The Declaration under 37 CFR 1 .132 filed 
09/30/2003 and 01/1 1/2007 was evaluated and acknowledge by the examiner (See 
Final Office Action mailed 04/06/2007, starting page 17). 
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Prior Art Made Of Record 

1 . Wang et al. (US Patent No. 5,802,361 , filed: September 30, 1994) discloses a 
method and system for searching graphic images and videos. 

2. Kinra et al. (US Patent No. 5,731 ,991 , filed: May 3, 1 996) discloses a software 
product evaluation. 

3. Rose et al. (US Patent No. 5,724,567, filed: April 25. 1994) discloses a system 
for directing relevance-ranked data objects to computer users. 

4. Aggarwal et al. (K. K. Agganwal and Yogesh Singh) (Non-Patent Literature: 
"Software Reliability Apportionment using the Analytic Hierarchy Process"; ACM 
SIGSOFT; Software Engineering Notes vol 20 no 5; December 1 995; New York, NY, 
USA). 

5. Barber et al. (US 5,751 ,286). 
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Points Of Contact 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Giovanna Colan whose telephone number is (571) 272- 
2752. The examiner can normally be reached on 8:30 am - 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Breene can be reached on (571 ) 272-4107. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more Information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Giovanna Colan 

Examiner ^ H 

Art Unit 2162 ^K^lN^C- ^T^^AiMM^ 
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